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Cost  Growth,  Acquisition  Policy,  and  Budget  Climate 

David  L.  McNicol* 

Discussions  of  acquisition  reform  over  the  past  twenty- five  years  have  usualfy  put  the 
Department  of  Defense  (DoD)  Program  Manager  (PM)  and  personnel  in  the  program  otfiee  in 
the  foreground.  These  people  oversee  the  eontraetors  and  do  myriad  things  that  must  be  done  by 
the  government  for  a  major  aequisition  program  to  move  forward — eontraeting,  finaneial 
management,  and  test  planning,  among  many  others.  In  the  baekground  are  the  eontraetors  who 
typiealfy  do  the  development  and  manulaeturing.  A  good  program  will  not  oeeur  if  the 
government  personnel  and  contractors  do  not  do  their  jobs  well.  It  is  equally  true  that  if  these 
individuals  and  organizations  do  their  jobs  weU,  a  good  outeome  for  the  program  is  more  likely. 

What  this  foeus  on  the  DoD  PM,  the  program  offiee  personnel,  and  the  eontraetors’  PMs 
and  workers  leaves  out  are  laetors  they  must  aeeept  as  “givens.”  These  givens  are  subject  to 
changes — sometimes  large  and  lairfy  sudden — that  presumabfy  have  substantial  eonsequenees 
for  program  outeomes.  One  of  the  givens  is  DoD  aequisition  poliey  and  proeess.  A  seeond  is  the 
DoD  budget,  whieh  does  not  determine,  but  general^  has  a  marked  infiuenee  on,  the  lunding  for 
individual  programs. 

This  paper  summarizes  the  results  of  researeh  done  at  the  Institute  for  Defense  Anafyses'  on 
whether,  taking  aeeount  of  lunding  elimate,  ehanges  in  DoD  aequisition  poliey  and  proeess  had  a 
discernible  efieet  on  growth  of  Program  Aequisition  Unit  Cost  (PAUC)  of  major  defense 
aequisition  programs  (MDAPs).  The  paper  attempts  to  shed  some  light  on — and  as  it  turns  out,  to 
ehallenge — three  assumptions  that  often  are  imp  lie  it  in  diseussions  of  aequisition  reform 

•  Cost  growth  and  other  problems  of  program  outcome  primarily  refteet  what  does  and 
perhaps  does  not  take  plaee  in  the  aequisition  realm 

•  Changes  in  aequisition  poliey  and  proeess  ean  be  expeeted  to  have  substantial  efieets  on 
the  eost,  sehedule,  and  performanee  results  of  MDAPs. 

•  The  ingrained  eultures  of  DoD  aequisition  organizations  are  a  substantial  obstaele  to 
steps  that  might  reduee  cost  growth. 

While  not  organized  around  these  topies,  the  paper  provides  results  that  bear  direetty  on  them 

Acquisition  Regime  and  PAUC  Growth 

DoD  aequisition  poliey  and  proeess  over  the  period  1970-2007  ean  be  grouped  into  five 
suceessive  regimes: 

1.  The  Defense  Systems  Aequisition  Review  Couneil  (DSARC),  1970-1982 

2.  The  Post-Carlueci  Initiatives  DSARC,  1983-1989 

3.  The  Defense  Aequisition  Board  (DAB),  1990-1993 

4.  Aequisition  Reform  (AR),  1994-2000 

5.  The  DAB  -  Post  Aequisition  Reform,  2001-2007 


*  Research  Staff  Member,  Institute  for  Defense  Analyses.  Valuable  comments  reflected  in  the  paper  were  provided 
by  David  Sparrow,  Brian  Rieksts,  and  Prashant  Patel  Sarah  Bums  provided  advice  and  assistance  on  the 
statistical  analysis.  Linda  Wu  managed  data  acquisition  and  the  database. 
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Analyses,  September  2014.  Thispaperwas  sponsored  by  the  Director,  Performance  Assessments  and  Root  Cause 
Analyses  of  the  Office  of  the  Under  Secretary  of  Defense  (Acquisition,  Technology  and  Logistics .) 
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Table  1  displays  the  average  PAUC  growth  for  MDAPs  that  passed  Milestone  (MS)  B  or 
(pre-2001)  MS  II  or  filed  a  first  Seleeted  Aeqrdsition  Report  (SAR)  in  eaeh  of  these  regimes.  The 
PAUC  growth  figures  all  are  measured  from  the  MS  II/B  baseline  and  normalized  to  the  MS  II/B 
total  inventory  objeetive.  There  are  a  number  of  interesting  aspeets  to  these  data;  lor  example, 
the  high  PAUC  growth  during  the  AR  period  and  the  lower  PAUC  growth  lor  2001-2007. 
Granting  that,  the  single  most  notable  feature  of  these  data  is  the  absenee  of  any  trend  in  PAUC 
growth.  If  ehanges  in  aequisition  poliey  and  proeess  have  had  a  sustained  influenee  on  PAUC 
growth,  it  does  not  show  up  in  this  table. 


Table  1.  Average  PAUC  Growth  in  Successive  Acquisition  Regimes 


Acquisition  Regime 

Time  Period 

Average  PAUC 
Growth 

No.  of 

Observations 

DSARC 

1970-1982 

32% 

48 

Post  Carlucci  Initiatives  DSARC 

1983-1989 

19% 

40 

DAB 

1990-1993 

36% 

11 

Acquisition  Reform  (AR) 

1994-2000 

66% 

27 

DAB  post  AR 

2001-2007 

19% 

25 

Broadly,  there  are  two  ways  to  explain  the  absenee  of  sustained  efieets  of  aequisition  poliey 
and  proeess  on  the  PAUC  growth  data.  First,  they  may  in  feet  not  have  a  strong  or  eonsistent 
efieet  on  PAUC  growth.  Seeond,  aequisition  poliey  and  proeess  may  have  substantial  efieets  that 
are  masked  by  some  other  feetor  or  faetors. 

Funding  Climate  and  PAUC  Growth 

Thinking  along  the  lines  of  the  seeond  of  these  possibilities  led  to  eonsideration  of  whether 
ehanges  in  the  DoD  frinding  elimate  might  be  assoeiated  with  PAUC  growth.  The  period  1970- 
2007  ineludes  two  sub-periods  during  whieh  the  DoD  budget  was  Relatively  Constrained: 
FY  1970-FY  1980  and  FY  1987-FY  2002.  It  also  ineludes  two  sub-periods  in  whieh  MDAP 
new  starts  Ibund  frinding  elimate  Relative^  Aeeommodating:  FY  1981-FY  1986  and  FY  2003- 
FY  2007.  Table  2  displays  the  average  PAUC  growth  data  lor  these  four  sub-periods. 


Table  2.  Average  PAUC  Growth  in  Different  Funding  Climates 


Relatively  Constrained 

Relatively  Accommodating 

Period  (FY) 

PAUC  Growth 

Period  (FY) 

PAUC  Growth 

1970-1980 

35%  (42) 

1981-1986 

12%  (35) 

1987-2002 

53%  (55) 

2003-2007 

7%  (19) 

Note:  Numbers  in  parentheses  are  the  number  of  observations  available. 


These  data  make  it  elear  that  the  average  PAUC  growth  in  Relatively  Constrained  funding 
elimates  was  fer  larger  than  it  was  in  periods  during  Relative^  Aoeommodating  funding 
elimates — by  a  feetor  of  three  in  the  first  eomparison  and  by  a  feetor  of  more  than  seven  in  the 
seeond. 
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Acquisition  Regime  and  Funding  Climate 

Table  3  expands  Table  2  by  replaeing  the  firnding  climate  sub-periods  with  the  acquisition 
policy  and  process  regimes.  This  table  provides  results  for  two  sets  of  natural  experiments.  First, 
the  PAUC  growth  columns  give  the  efiect  of  changes  in  the  acquisition  regime  for  a  given 
fonding  climate.  Second,  the  rows  show  the  effect  of  funding  climate  for  a  given  acquisition 
regime.  For  example,  the  first  eleven  years  of  the  DSARC  (FY  1970-FY  1980)  were  in  a 
Relatively  Constrained  funding  climate,  while  the  next  two  (FY  1981-FY  1982)  were  in  a  period 
in  which  the  DoD  budget  was  Relatively  Accommodating. 


Table  3.  Average  PAUC  Growth  by  Acquisition  Regime  and  Topline  Condition 


Acquisition  Regime 

Relatively  Constrained 

Relatively  Accommodating 

Period  (FY) 

PAUC  Growth 

Period  (FY) 

PAUC  Growth 

DSARC 

1970-1980 

35%  (42) 

1981-1982 

11%  (6) 

PostCarlucci  DSARC 

1987-1989 

34%  (11) 

1983-1986 

13%  (29) 

DAB 

1990-1993 

36%  (11) 

None 

N/A 

Acquisition  Reform  (AR) 

1994-2000 

61%  (27) 

None 

N/A 

DAB  post  AR 

2001-2002 

57%  (6) 

2003-2007 

7%  (19) 

Note:  Numbers  in  parentheses  are  the  number  of  observations  available. 


Statistical  analysis  of  the  data  behind  the  averages  in  this  table  leads  to  two  conclusions. 
First,  there  is  no  statistically  significant  improvement  or  worsening  of  PAUC  growth  correlated 
with  the  different  acquisition  policy  and  process  regimes.  This  result  is  not  surprising  for  the 
Relatively  Accommodating  climate  (column  on  the  right).  In  contrast,  in  the  Relative^ 
Constrained  periods  (column  on  the  left),  average  PAUC  growth  for  AR  and  DAB  post-AR  is 
noticeably  higher  than  the  averages  for  previous  periods,  but  the  differences  proved  not  to  be 
statistically  significant  because  of  the  large  variance  among  programs  in  each  period. 

Second,  average  PAUC  growth  was  substantially  higher  in  a  Relatively  Constrained 
funding  climate  than  in  the  Relative^  Accommodating  climate.  We  have  only  three  natural 
experiments  of  changes  in  funding  climate  for  a  given  acquisition  regime,  since  two  of  the  five 
acquisition  regimes  (DAB  and  AR)  fall  entirely  within  one  funding  climate.  Each  of  these  three 
natural  experiments  on  the  effect  of  funding  climate  had  the  same  outcome — MDAPs  that  passed 
MS  ll/B  in  a  Relatively  Constrained  funding  climate  on  average  had  a  much  higher  PAUC 
growth  rate  than  those  that  passed  MS  II/B  in  a  Relative^  Accommodating  funding  climate  for  a 
given  acquisition  regime.  These  differences  are  statistically  significant  at  the  1  percent 
confidence  level  The  outcomes  of  the  first  two  experiments  are  virtually  identical — an  average 
PAUC  growth  of  35  and  34  percent,  respective^,  in  the  two  periods  when  funding  was 
Relative^  Constrained  and  average  PAUC  growth  of  11  percent  and  13  percent,  respective^,  in 
the  two  periods  when  the  funding  climate  was  Relatively  Accommodating.  The  effect  is  even 
more  pronounced  in  the  third  experiment  (DAB  post-AR) — 57  percent  in  FY  2001-FY  2002 
versus  just  7  percent  for  FY  2003-FY  2007. 
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Does  the  Resource  Allocation  Process  Play  a  Major  Role  in  PAUC  Growth? 

These  eonelusions  tend  to  ehallenge  a  fundamental  assumption  implieit  in  most  diseussions 
of  aequisition  reform:  that  the  main  eauses  of  PAUC  growth  are  to  be  found  in  the  aequisition 
realm — the  performanee  of  the  eontraetors,  the  elfeetiveness  of  the  PM,  the  adequaey  of  the 
developmental  test  plan,  and  the  eompleteness  of  the  systems  engineering  plan,  among  others. 
This  assumption  is  hard  to  maintain  when  the  many  ehanges  in  aequisition  poliey  and  proeess 
made  in  the  past  four  deeades  have  not  had  statistiealfy  signifieant  elfeets  on  PAUC  growth,  but 
there  is  a  signifieant  assoeiation  between  PAUC  growth  and  funding  elimate  at  the  point  when 
the  MS  II/B  baseline  was  set. 

The  assoeiation  between  PAUC  growth  and  funding  elimate  suggests  that  the  resouree 
alloeation  proeess,  partieularfy  at  the  Serviee  level,  plays  an  important  role  in  eost  growth.  This 
does  not  mean  “budget  instability.”  Budget  instability  is  a  term  of  art  for  ehanges  in  MDAP 
funding  through  the  annual  resoureing  eycle  and  “taxes.”  Budget  instability  is  a  ehronie 
eondition,  present  to  some  degree  in  all  periods.  What  this  paper  observed  is  a  reeurring 
pattern — that  MDAPs  that  passed  MS  II/B  during  periods  of  Relative^  Constrained  funding,  on 
average,  had  mueh  higher  PAUC  growth  than  those  that  passed  MS  II/B  when  funding  was 
Relatively  Aeeommodating. 

The  eonjeeture  that  the  resouree  alloeation  proeess  plays  an  important  role  in  eost  growth 
gets  some  support  from  an  unexpeeted  direetion — MDAPs  with  negative  eost  growth,  of  whieh 
there  are  twenty-nine  in  our  sample.  Negative  PAUC  growth  is  reeorded  if  the  aetual  eost  of  a 
program  proves  to  be  less  than  the  eost  in  the  MS  II/B  baseline.  Assuming  the  program  was 
funded  to  its  MS  II/B  baseline,  this  implies  that  over  time  funds  ean  be  taken  from  the  program 
in  question  and  realloeated  to  other  applieations,  ineluding  other  aequisition  programs.  The 
program,  then,  effeetively  ean  be  used  as  a  “bank” — a  way  to  hold  reserves  in  relative  safety 
until  they  are  needed.  A  bank  of  this  sort  is  more  likely  to  be  needed  in  a  Relative^ 
Aeeommodating  funding  elimate,  as  it  ean  then  serve  as  a  way  to  delay  final  deeisions  on 
alloeation  of  the  higher  level  of  funding  that  has  beeome  available.  We  would  therefore  expeet  to 
find  a  higher  proportion  of  MDAPs  with  negative  PAUC  growth  in  the  Relative^ 
Aeeommodating  elimates,  and  this  is  what  we  observe.  About  30  pereent  of  our  MDAPS  that 
passed  MS  II/B  in  Relative^  Aeeommodating  funding  elimates  show  negative  PAUC  growth, 
eompared  to  about  10  pereent  aeross  the  periods  of  Relatively  Constrained  elimate. 

MDAPs  with  “high  eost  growth,”  whieh  we  define  as  quantity  normalized  PAUC  growth  of 
at  least  50  pereent,  also  suggest  an  influenee  from  the  resouree  alloeation  proeess.  DoD  resouree 
managers,  partieularly  at  the  Serviee  level,  have  only  a  few  tools  for  responding  to  a  Relatively 
Constrained  funding  elimate.  One  of  these  is  to  impose  top-down  limits  on  the  funding  for 
partieular  MDAPs  as  they  approaeh  MS  II/B.  Plausibfy,  the  result  will  be  partieularly  optimistie 
programmatie  and  eosting  assumptions,  whieh  lead  to  an  expeetation  that  MDAPs  started  in 
periods  of  Relative^  Constrained  funding  elimate  will  have  a  larger  proportion  with  high  PAUC 
growth.  This  is  again  what  is  observed.  During  periods  of  Relative^  Constrained  funding 
elimate,  about  40  pereent  of  MDAPs  had  very  high  PAUC  growth.  In  eontrast,  during  periods  of 
Relatively  Aeeommodating  funding  elimate,  only  about  7  pereent  of  MDAPs  experieneed  high 
PAUC  growth. 

Taking  both  funding  elimates  together,  85  pereent  of  MDAPs  with  PAUC  growth  of  at  least 
50  pereent  passed  MS  II/B  during  a  Relative^  Constrained  funding  elimate.  These  MDAPs  had 
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an  average  PAUC  growth  of  93  pereent  and  accounted  for  just  over  three-quarters  of  total  PAUC 
growth.  Excluding  high  cost  growth  MDAPs  and  MDAPs  with  negative  PAUC  growth,  average 
PAUC  growth  across  the  two  fimding  climates  was  just  18  percent.  High  PAUC  growth  is  then 
predominant^  a  feature  of  programs  with  PAUC  growth  of  at  least  50  percent,  and  these 
programs  mainly  passed  MS  II/B  in  periods  of  Relative^  Constrained  funding  climates.  These 
points  are  important  because  they  suggest  that  reforms  directed  to  the  average  or  typical  MDAP 
may  miss  the  real  source  of  the  problem 

Implications  for  Discussions  of  Acquisition  Reform 

This  paper  points  to  three  implications  for  a  discussion  of  acquisition  reform  First,  the 
relevant  context  for  understanding  PAUC  growth  is  the  interlace  between  the  acquisition  process 
and  the  resource  allocation  process.  The  cmcial  evidence  behind  this  point  is  the  strong 
association  between  funding  climate  and  PAUC  growth.  Resource  managers  must  think  in  terms 
of  a  portfolio  of  programs  at  various  stages  of  the  acquisition  life  cycle,  from  efforts  in  the 
technology  base  through  programs  nearing  the  end  of  production.  When  a  program  is  completed, 
it  opens  a  resource  “hole”  that  programs  emerging  from  Engineering  and  Manufacturing 
Development  can  occupy.  In  turn,  programs  earlier  in  the  acquisition  cycle  can  move  forward  as 
well  When  funding  for  acquisition  turns  down,  these  holes  get  smaller,  or  close  entirely,  or 
require  cuts  in  funding  for  ongoing  programs.  The  alternatives  available  in  this  circumstance  are 
all  undesirable — cancellations  of  programs,  delays  in  new  starts,  stretches,  and  unrealistic 
pricing.  The  evidence  summarized  here  suggests  that  it  is  in  this  context  that  high  PAUC  growth 
arises. 

Second,  it  seems  unlikely  that  further  broad  changes  in  the  acquisition  process  would  have 
a  major  effect  on  PAUC  growth.  The  research  found  no  evidence  that  the  efforts  to  strengthen 
the  acquisition  process  through  the  years  have  resulted  in  lower  or  higher  PAUC  growth.  This 
does  not  mean  that  the  DAB  process  does  not  provide  a  useful  discipline  on  acquisition 
programs;  moreover,  further  changes  in  acquisition  policy  or  process  might  be  warranted  for 
reasons  of  good  government.  The  evidence  does,  at  a  rniriirnurn,  suggest  that  the  effects  of 
changes  in  the  acquisition  process  since  the  early  1970s  have  not  had  a  dominant  effect  on 
PAUC  growth. 

Third,  it  is  difficult  to  see  that  the  cultures  of  the  DoD  acquisition  organizations  are  a 
crucial  obstacle  to  improved  performance  on  cost  growth.  The  key  point  to  note  is  that  high 
PAUC  growth  is  not  persistent,  but  rather  episodic,  and  correlated  with  environmental  factors 
outside  of  the  control  of  the  acquisition  process.  There  is  remarkabfy  little  PAUC  growth  in 
periods  when  the  funding  climate  is  Relatively  Accommodating.  It  seems  fair  to  ask  if  it  makes 
sense  to  assert  that  an  entrenched  culture  sometimes  results  in  high  cost  growth  and  other  times 
in  low  cost  growth.  Just  how  is  it  that  the  A  team  takes  the  field  so  quickly  and  quietly  when  the 
budgetary  sun  comes  out?  And  why  even  in  bad  budgetary  weather  do  more  than  half  of  MDAPs 
exhibit  comparatively  modest  PAUC  growth? 
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